A Fast Attention Kernel for MI300X, Written in Hip, Not Assembly

A deep dive into a bf16 forward attention kernel for AMD MI300X, written in HIP with instruction level control rather than raw assembly.

View Post on Scour ↗

More from moonmath.ai on Scour.

Discussed on Hacker News